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A methodology for designing the information structures for decision 
makers who comprise the boundary between an organization and its 
environment is presented. The environment is modeled as a source that 
generates symbols or messages that the organization members must process 
without being overloaded. Two basic information reduction strategies are 
considered: 1) creation of self contained tasks, and 2) creation of 
slack resources. The former leads to the partitioning of the input signal 
and the parallel processing of the partition; the latter to alternate 
processing where each decision maker receives signals according to some 
deterministic rule but is given more time to process them, i.e t , a delay 
is introduced. These two strategies are then integrated to produce a 
variety of information structures for special cases. 
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INTRODUCTION 


An organization, perceived as an open system [1], interacts with its 
environment: it receives signals or messages in various forms that 
contain information relevant to the organization's tasks. These signals 
must be identified, analyzed and then transmitted to their appropriate 
destinations within the organization. The way in which an organization 
accepts and processes these signals affects its internal structure and 
has direct consequences on its performance. The sources of the signals 
and their properties, the tasks to be performed, and the capabilities 
and limitations of the individuals comprising the organization are key 
factors in determining the structure of an organization. 

A major simplification occurs when only the boundary between the 
organization and its environment is considered. While the organization 
members on the boundary may occupy different positions in the internal 
organizational structure, their common characteristic is that they 
receive direct inputs from the environment. In that sense, they 
constitute a single echelon. However, individuals, or groups of 
individuals, can have very different capabilities and limitations that 
reflect, indirectly, their position in the organization. For example, 
they can process only certain classes of signals (specialization) or 
they can deal with limited levels of uncertainty. Since it is important 
to remember that the single echelon may induce commanders as well as 
operators of monitoring systems, executives as well as clerks, the term 
decision-maker is used to describe all members. 

In this paper, a methodology for designing information structures for 
single echelon organizations is developed. The choice of decision makers 
(DMs) that comprise the single echelon (SE) and the rules for assigning 
signals to them define the organizational form. 

For the types of organizations considered, the performance of a task 
is equivalent to the processing of information, where information is defined 
to be the data received by the DMs in the SE. Galbraith has argued that 
variations in the amounts of information (data) that are processed are 
primarily responsible for the variations in organizational forms, [2] 
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A tacit assumption in this work is that a single DM cannot process 
the available data while simultaneously achieving the desired performance 
level. When a DM has been assigned more data than he is able to process 
in the prescribed time interval, while still maintaining a given perfor¬ 
mance level, he can react in one of several ways. He may decide to reduce 
the amount of data he has to process by either randomly (rejection) or 
selectively (filtering) omitting data. The amount of data he may be 
required to process may be reduced also by having it preprocessed. 

He may decide to reduce the number of categories of discrimination, 
i.e., approximate the inputs, or he may reduce the required level of 
accuracy for processing the data and, in so doing, reduce the number 
of different outputs. If these alternatives seem unsatisfactory, he 
may decide to receive all the data, allowing queues to build up, de¬ 
laying the processing during periods of peak loads and attempting to 
catch up during slow periods. Otherwise the DM may simply choose not to 
perform the task. J. Miller found that at moderate rates of information in¬ 
put overload, all these methods described were used about equally. When the 
input rate far exceeded a DM's processing capacity, however, random and 
selective omission were the most significant methods of dealing with the 
situation. [3]. 

An alternative to having the data preprocessed is the employment of 
multiple parallel channels [4]. The concept of parallel DMs is analogous 
to the idea of distributed information processing with each DM performing 
a subtask. Many studies in the literature have revealed that as the 
uncertainty of the tasks increases, the "flatter,” i.e., more distributed, 
an organization should become with respect to its DMs. [4] 

Galbraith has suggested two information reduction sti ; for 

organizations to address this issue: (1) Creation of Self-Conu xned Tasks, 
and (2) Creation of Slack Resources. [2] In the first strategy, the 
original task is divided into a set of subtasks. This reduces the diversity 
of inputs each DM receives as well as the diversity of outputs he must 
produce. In the second strategy, the slack resource of interest is time. 
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Thus, the trade-off between performance and delay in accomplishing the task 
becomes an important design consideration. 

Two types of processing modes will be considered, parallel processing, 
which is associated with the first strategy, and alternate processing, 
which is associated with the second strategy. These are fundamental 
strategies as discussed first by Drenick [5], that can be used to pro¬ 
cess the incoming signals without overloading any DM in the single echelon. 
The two fundamental modes can be integrated in various ways so as to deve¬ 
lop more complex organizational forms. 

Parallel processing is introduced in order to reduce the amount of 
information any particular DM receives. This assumes the task can be 
divided into subtasks with each subtask requiring some subset (not 
necessarily mutually exclusive) of the information. The subtasks 
are selected and assigned to DMs in such a way that each DM is capable 
of processing his data before his next input is received. This is refer¬ 
red to as parallel processing because the subtasks are carried out in 
parallel within the same time interval. This processing mode guarantees 
that the expected delay of any processed input is equal to the mean input 
interarrival time. The structure of the single echelon with parallel 
processing is shown in Figure 1? S represents the source, z^ the signal 
received by the i-th DM and y^ is the output he produces. 



Figure 1. Parallel Processing 
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If signals arrive at a rate 5 , and a DM requires more than time 5 

to process the information (queueing of information has been removed from 
further consideration), additional DMs are introduced into the single 
echelon; each DM is assigned a different input signal. The number of 
additional DMs must be sufficient to receive and process information so 
that no DM receives another input signal until the previous one he 
received has been processed. This is referred to as alternate processing 
because the assignment of the inputs alternates among the DMs in the SE. 
The structure of a single echelon with one form of alternate processing 
is shown in Figure 2. The precise rule for allocating inputs to the 
various DMs determines the minimum number of DMs necessary to process 
the inputs without any DM being overloaded. 



*i a *i(t)x 


Z 2 = 7T 2 (t)x 


Figure 2. Al 









In general, parallel processing is associated with the partitioning 
of the task into subtasks, in the absence of any slack in time. Alternate 
processing is associated with the allocation of the slack resource (time). 
The task is not partitioned, but each DM is allotted more time to carry 
out complete tasks. In both parallel and alternate processing the input 
rate is equal to the output rate; in alternate processing, however, a 
delay that is strictly greater than the mean input interarrival time is 
introduced. 
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TASK AND DECISION MAKER MODELS 


In this section, two elements of the design problem are modeled: 
the task to be performed and the properties of the decision makers who 
comprise the single echelon. 

The single echelon is assumed to receive signals from one or more 
sources external to it. Every 5^ units of time on the average, each source 
n generates symbols, signals, or messages x^ from its associated alphabet 
X^, with probability p^, i.e., 


p . = p (x = x .) 
ni n m 


x . £ X 
ni n 


i 


1 , 2 , 




n 


( 1 ) 


L p . = 1 ; n - 1,2,...,N f 

ni 

i=l 


where y is the dimension of X . Therefore, S* 1 is the mean frequency of 
n n n 1 

symbol generation from source n. 

The task to be performed is defined as the processing of the input 
symbols by the single echelon to produce output symbols. It is as¬ 
sumed that a specific complex task that must be performed can be modeled 
by N' such sources of data. Rather than considering these sources sepa¬ 
rately, one supersource composed of these N' sources is created. 

The input symbol x*, may be represented by an N f -dimensional vector with 
each of the sources represented by a component of this vector, i.e. T 

x’ = (x 1 ,... f x nf ...,* H ,) ; x' £ K (2) 


To determine the probability p^. that vector x^j is generated, the inde- 

If all components are 


pendence between components must be considered, 
mutually independent (see, e.g 
babilities that each component of x? takes on its respective value from 
its associated alphabet: 


[5]) then is the product of the pro- 
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N' 


■, -n 


n=l 


P nj' 


(3) 


When all components of the input vector are mutually independent this is 
referred to as being of finest grain . In many situations, this assumption 
is unrealistic; it is more common to have some components probabilistically 
dependent. 

If two or more components are probabilistically dependent on each 
other, but as a group are mutually independent from all other components 
of the input vector, then these dependent components can be treated as 
one new supercomponent with a new alphabet. Then a new input vector, 

3C, is defined, composed of the mutually independent components and these 
supercomponents. This new x is of finest grain. 

This model of the sources implies synchronization between the indivi¬ 
dual source elements so that they may be treated as one input vector. 
Specifically, it is assumed that the mean interarrival time for each 
component 5^ is equal to <5 . 

Finally, it is assumed that every component of each input vector must 
be processed by at least one DM. If the objective is to minimize the 
number of DMs necessary to process the input vector, then there is no 
advantage to having a component processed more than once, since this 
could require additional DMs. Alternatively, reliability considerations 
may require that some redundancy in processing be present. 

In general, each of the decision makers in the single echelon processes 
some subset of the components comprising the input vector*. Each DM is 
distinguished by 

• a processing time function, T, which yields the mean time for 
processing a particular set of components, 

• his specialization; e., which components he is able or qualified 
to process, and 

• a cost function. 

A DM is said to be overloaded when the time required for him to process the 
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components he is assigned exceeds 5 , the mean interarrival time of input 
symbols requiring processing. 

The uncertainty of the input symbol generated and the number of 
possible input-output pairs are two of the factors that affect the 
mean processing time. Miller introduced a processing time function 
which has an information theoretic interpretation while Hyman and Hick 
provided experimental evidence that information, rather than the number 
of inputs or outputs, was a more appropriate measure [3]. In order to 
express analytically the mean processing time, it is necessary to des¬ 
cribe first the partitioning of the input vector. Let the vector x be 
partitioned into groups of components and let the k-th partition be 
denoted by an s^-dimensional vector z^. The k-th partition is derived 
from the input vector x using the partitioning matrix i.e., 

5 k = \ 5 (4) 

where TT, is of dimension s, x N and rank s, . Each column of tt has 
k k k 

at most one non-zero element (unity) while each row has exactly one 
non-zero element (unity). Since the order of the components in z^ 
is of no consequence, any other matrix obtained by interchanging the 
rows of yields the same partition. 

The partitioning matrix assigned to the m-th DM, tt^, specifies 
the set of symbols that he must process. The information structure, 

II, for a single echelon consisting of M DMs is defined by the set of 
M partitioning matrices associated with the DMs. 

The mean processing time for the m-th DM who has been assigned parti¬ 
tion k is defined to be: 


-m 

\ = t 


m 


in , 

+ c H, 


(5) 


where H. is the entropy associated with the set of components z . specified 
K -K3 

by the partition matrix i.e., 
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( 6 ) 


** m ~] P( -kj ) 109 

and where t m and c m are parameters characterizing the particular DM. 

Since it has been assumed that all components in the input vector are 
mutually independent, the entropy of z^ is equal to the sum of the entro¬ 
pies of each of the components of z^. 

The expression of the mean processing time (5) may be obtained 
by averaging, over all elements j in the k-th partition, the symbol pro¬ 
cessing time given by 



. m m n x 

t - c log p(z ) 


(7) 


While the model for the mean processing time (5) is a plausible one and 
is consistent with experimental data, the inferred model for the individual 
symbol processing times is not {for a discussion, see [3]). 

Consider now the M decision makers that are available to the orga¬ 
nization designer. These DMs can be grouped in several ways according 
to their mean processing time function (5), their specialization and 
their cost. 

In the simplest case, all DMs are identical. This implies the 
same mean processing time, 


x™ = t = t + c for all m 

no specialization, and equal cost. 

Groups of identical DMs are considered next. Decision makers within 

q 

a specified group, M , g = 1,2,...,G, possess identical processing time 
functions, are able to process the same types of components and have 
identical costs. 

Decision makers are often experts or specialists in a particular area 
of an overall task with an attendant reduction in the average processing 
times for tasks in the given area. Another form of specialization is the 
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use of machines which are often limited with respect to the types of data 
they can process. Specialization can be thought of in the context of 
this work as a constraint that allows the DM to access and process only 
certain components of data. 

Let G groups of DMs exist with identical DMs within each group 

and let each of these groups be specialized so that it can be assigned 

g 

only components from a set of components L , g = 1,...,G. The cost of 
each DM depends on the group he belongs to and his area of specialization. 

The input vector has been constructed so that its components are in¬ 
dependent. These components can be grouped together in terms of several 
attributes. Components can be grouped so that within each group compo¬ 
nents have alphabets of equal size and identical probability distributions. 
Groups can be formed of components that must be processed together, even 
though they are independent. Another attribute is dependent on the DMs and 
their specialization. If each DM can process only certain alphabets or even 
subalphabets, then the components (and their alphabets) can be grouped 
together according to which DM can process them. 

At this point, it is possible to state the first two steps in the 
design of information structures. 

STEP 1: Task 

a) Construct a single supersource; 

b) Restructure input vector so that its components are 
mutually independent; 

c) Identify groups of components with alphabets that 
have identical probability distributions; 

d) Identify components that must be processed together; 

e) Identify alphabets and subalphabets that can be proces¬ 
sed by specialized DMs. 

STEP 2 s Decision Makers 

a) Group DMs according to their processing time functions; 

b) Group DMs according to their specialization. 

Once these steps have been carried out, the problem of designing the in¬ 
formation structure for a single echelon can be formulated. Parallel 
processing will be considered first. 




( 6 ) 


\ = " I P<* kj > log p(z ) 

J 

and where t m and c m are parameters characterizing the particular DM. 

Since it has been assumed that all components in the input vector are 
mutually independent, the entropy of z^ is equal to the sum of the entro¬ 
pies of each of the components of z^. 

The expression of the mean processing time (5) may be obtained 
by averaging, over all elements j in the k-th partition, the symbol pro¬ 
cessing time given by 


X 


m 

kj 


t m - 


m 


log p(z R J 


(7) 


While the model for the mean processing time (5) is a plausible one and 
is consistent with experimental data, the inferred model for the individual 
symbol processing times is not (for a discussion, see [3]). 

Consider now the M decision makers that are available to the orga¬ 
nization designer. These DMs can be grouped in several ways according 
to their mean processing time function (5), their specialization and 
their cost. 

In the simplest case, all DMs are identical. This implies the 
same mean processing time, 


X™ = X_ = t + c H, for all m 

k k k 

no specialization, and equal cost. 

Groups of identical DMs are considered next. Decision makers within 
, , a 

a specified group, , g = 1,2,...,G, possess identical processing time 
functions, are able to process the same types of components and have 
identical costs. 

Decision makers are often experts or specialists in a particular area 
of an overall task with an attendant reduction in the average processing 
times for tasks in the given area. Another form of specialization is the 
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PARALLEL PROCESSING 


In a parallel processing structure, partitions of the input symbol 
are selected and assigned to the decision makers (DMs) in the 
organization. The group of DMs who, together, process the entire input 
symbol form the single echelon (SE). Each DM is constrained to process 
a partition of components from those that do not overload him, i.e., from 
those that result in a mean processing time of 5 or less. 

Mathematical programming is an appropriate modeling approach for 
this class of problems. This approach seeks "the optimum allocation 
of limited resources among competing activities under a set of constraints 
imposed by the nature of the problem being studied." [6 ] In this 
context, the components of the input vector correspond to the limited 
resources, the DMs correspond to the competing activities and the 
constraint sets include processing time capabilities and specialization 
limitations of each DM. 

Explicit enumeration of ail distinct partitions of components 
results in a problem with very high dimensionality. Fortunately, 
the mutual independence of the components of the input vector allows 
an alternative formulation which reduces significantly the size of 
the problem. This is a consequence of not having the distinct partitions 
enumerated explicitly. Rather, only the components and the DMs need 
be considered explicitly. 

In the implicit formulation, individual components are selected 
and assigned to each DM in the model. The group of components 
assigned to the m-th DM defines the partition vector. In this way, 
the required M partition vectors are constructed implicitly. The 
conditions for selecting and assigning components are 

a) every component is processed, and 

b) no DM is overloaded. 


- 11 - 

















A DM will not be overloaded, if the average time he requires to 
process the components assigned to him does not exceed <$. The mean 
processing time (5 ) is assumed to be given by 


-m 


= St 


m 


+ c m H 


(5') 


where s is the number of components assigned to the DM and (t m ,c m ) are 
parameters that characterize the m-th DM. Since the components have 
been assumed to be mutually independent, the entropy H is equal to the 
sum of the entropies of the s components. Since the components assigned 
to the m-th DM are not known a priori, a binary indicator variable Y 

nm 

is introduced which includes the time for processing component only 
if it is assigned to the DM: 


(t m + c m H ) Y = 
n nm 


(t m + c m H ) if y =1 
n nm 


if Y =0 
nm 


Furthermore: 


rm m in . * 

T=> t+cH)Y <5 
n run- 


in ■“* 1,2,...,M 


( 10 ) 


i.e., T m must be less than or equal to 5 to guarantee the m-th DM is 
not overloaded. 

The coefficients of the variables Y in constraint set (10) are 

nm 

clearly not restricted to unity or 2ero, implying that the formulation 
is not a pure network. It is a generalized network (GN), however, since 
each variable appears in at most two constraint equations. The sets of 
constraints comprising this GN formulation are given by (8),(9) and (10). 

The objective function for this problem that is to be minimized is 
the number of decision makers required to process all the components 
without overload. 
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The information structure can be constructed from the optimal 
solution to this problem. 

Partitioning matrices, corresponding to the set of components 

x for which Y =1, for each m, are inferred and then combined to 
n run 

define the information structure: 


n = 




m 



) 


In the following sections, several special cases are presented 
to illustrate the solution procedures for this class of problems. 


Single Group of Identical DMs 


All components are assumed one-dimensional and mutually indepen¬ 
dent and all DMs possess identical properties. These simplifying 
assumptions do not lead to a reduction in the dimensionality of the 
GN, however. Each DM must be considered separately and his parti¬ 
cular assignment of components obtained. This knowledge would 
be lost,if a single representative DM was used instead. 

There is an alternative approach, however, to solving the problem 

of selecting and assigning components to all DMs simultaneously, which 

takes advantage of these simplifying assumptions. This approach consists 

* 

of sequentially solving M MP problems belonging to a class known as knap¬ 
sack problems. A knapsack problem (KP) is composed of exactly one cons¬ 
traint and variables which are all binary. The KP formulation for the 
m-th problem is: 


T m Y < (S 
n mn — 


m — 1,2,. •., M 


n e L 


m 


where L m is the set of components available for assignment; i.e., not 
assigned in one of the previous (m-1) KPs. The set L m has dimension 

where 
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The first KP assigns as many of the N components as possible (s^) to 
a DM. The second KP assigns as many of the remaining (N-s^) components 
as possible to another DM. 

This process is repeated until all N components are assigned. Very 

efficient algorithms using Branch anu Bound techniques exist to solve 

* 

these KPs. [3] This leads to the possibility that the M problems, 
each with (1+s^) variables and one constraint, may require cumulatively 
less total computer time than solving one GN problem with M* N variables 
and (M+N) constraints. 

The construction of the associated information structure proceeds 
as described earlier in this section. Each partitioning matrix specifies 
the components assigned to and processed by the m-th DM. Since the DMs 
are identical, the particular assignment of partitioning matrices to 
DMs is arbitrary. 

Many Groups of DMs 

The assumption that DMs in the g-th group, g = 1,2,...G possess 

identical properties (G _> 2), does not lead to a reduction in the 

* 

dimensionality of the GN. The alternative approach of solving M KPs 

cannot be used either, unless the relative efficiency of DMs among groups 

q 

can be established and ranked, i.e., a DM from M can process any set of 
components more quickly than any DM from M g . If this dominance with 
respect to processing time functions exists, then the sequential approach 

rr 

used in the previous section could again be used. In particular, if 
contains the most efficient DMs and d g is its dimension, then the first 
d^ KPs would assign components to DMs from this g-th group. DMs from 
the second most efficient group would be considered next and this procedure 
would continue until all components were assigned. 

Single Group of Identical Components 

The third special case illustrates that under the assumptions that 
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a) all components are independent and 

b) all components' alphabets are of the same dimension 
and have identical probability distribution functions# 


the problem of selection and assignment of partitions of components to 
DMs does not require a GN algorithm or any other mathematical programming 
algorithm to solve it, A feasible solution# which requires the minimum 
number of DMs, can be obtained directly with relatively few computations. 

If the components of a partition vector are mutually independent, 
then the entropy associated with that partition is equal to the sum 
of entropies of each of the components in the partition, i.e., 

H(z ) = H(x_,...,x ') = } H(x ) = N’H 

-N IN w n o 

n=l 


The entropy of any partition of dimension s is equal to sH q . 

No restrictions have yet been placed on the DMs as to which 
components they may process. Thus, any component(s) that the m-th 
DM can process without overload may be assigned to him. Feasibility 
with respect to mean processing time requires that 


t m (s) + c m H(z ) = st m + c(sH ) < 5 , (11) 

-s o — 


The maximum number of components that the m-th DM can process 

★ 

without overload, s , is derived from the inequality (11) as follows: 
m 


st m + c m (sH ) <5 

o — 


^ ^ r / .m m„ . -1 

=> s < 5 (t + c H ) 

— o 


=> s 


m 


[5 (t m + c m H ) _1 ] 


m — 1,2 , . , , , M 

m = 1,2,.•.,M 

m = l,2,*t.,M 
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where |_"J denotes the function that yields the greatest integer less than 
or equal to its argument. 


In order to minimize the number of DMs required to process the input 

vector, components are assigned to those DMs who can process the greatest 

★ 

number of components in timeS . The s 's are ranked in order of magnitude. 
* m ★ 

The quantity s _ is defined to be the f-th largest s , m = 1,2,...,M; 
mr m 

f * 1,2,...,M. If each of two or more DMs can process the same maximum 
number of components, then the ranking among them is arbitrary. 

★ 

To determine M , the minimum number of DMs necessary to process the 
input vector, DMs are added until all components are assigned, i.e.. 



Note that in this formulation there is no distinction in the cost 
between DMs of different capabilities. 


The DMs corresponding to f = 1,2,...,M will be included in the 

* 

information structure. Each of the first M -1 DMs will process partitions 

* 

of dimension s . The last DM will process a partition of dimension less 
mf * 

than or equal to s *: 

mM 


★ 



f=l 


Since the components all have alphabets with identical probability 
distributions and DMs are not restricted as to which components they 
may process, the number of possible assignments is 


N!/ 


ft 


h. 


(S ml i)( 4 l) 


(s *\) 
mM 
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where is the number of groups of dimension j, j = 1,2,...,N. Let h. 
be unity if no groups of dimension j exist. The generic information 
structure is: 


n = 



* 



) 

* 


M 


where 7T is the k -th partitioning matrix of dimension s - x N and 

“ f ^ t ^ mr 

f = 1,2,...,M ; m = 1,2,...,M . 


Many Groups of Identical Components 

Let there be G groups of components with components within a group, 

q 

L , g = 1,2,...,G, possessing alphabets with identical probability 

distributions. All components are assumed mutually independent. A 

q q 

component x can represent each group L . 

All possible partitions can be implicitly considered by using only 

the representative components and the dimension of each group, i.e., 

G representative components need be considered with each one being assigned 
a 

s times. It is possible that the same representative component may 
be assigned to the same DM several times. In order to allow for this 
possibility, several of the constraints must be modified in the general 
formulation of the problem. In particular, since a representative 

q 

component x can be assigned more than one time, Y is no longer 

gm 

restricted to be binary. Rather,it is restricted to be an integer 

q 

with an upper bound of s . The modified constraint set is: 


Y = 0,1.s g g = 1,2,...,G; m - 1,2,...,M. (12) 

gm 

To guarantee that every representative component is processed exactly 

q 

s^ times constraint set (8) is modified to 
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( 13 ) 


Figure 4 illustrates the reduction of the number of components and, 
consequently, of the overall dimensionality of the problem. As G, 
the number of distinct groups, decreases, the dimensionality of the 
problem is also reduced, since the size of the current problem is a 
linear function of the number of components. 


COMPONENTS 


DECISION MAKERS 



Figure 4. Groups of Identical Components 


The information structure can be obtained in a manner similar to 

that for groups of DMs. Each variable Y which has a nonzero value r^ 
g g 

implies that r components from L, g = 1,2,...,G, are assigned to the 
m-th DM with the assignment of particular components being arbitrary. 
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Specialization Among Decision Makers 

Specialization restricts the types of components that can be assigned 
to a particular DM, To imbed this constraint into the GN formulation 
it is only necessary to restrict the variable Y 

nm 

If x has five components and DM^ can only be considered for Pro¬ 
cessing components x 1# x 2 and Xy then variables Y^, Y , and Y^ would 

be included in the formulation while Y._, and Y_, would not be. For 

41 51 

each DM let L be the set of components that may be assigned to him. 

Then, the modified formulation is 


n = 1,2,...,N (14) 


m = 1,2,...,M (15) 

Y = 0,1 m = 1,2,...,M? n £ L(m) (16) 

nm 

The reduction in dimensionality is a function of the size of the sets L m 

and the decoupling which occurs when sets of components can onlv be 
assianed to particular sets of DMs. 

For example, let = (DM^,DM 2 ) , M 2 = ( DM^ , DM^ ) , L 1 = L 2 = (x^x^x^) 

3 4 

and L = L = (x^,x^). Figure 5 illustrates the decoupling of this problem. 

The specialization restriction reduces the number of variables Y that 

nm 

must be considered from 20 to 10. The decoupling effect allows two GNs 
to be solved, one with 6 variables, the other with 4 variables, rather 
than one GN with 10 variables. Since the complexity associated with the 
Branch and Bound algorithm used to solve this problem increases nonlinearly 
at a rate that is greater than unity, the ability to decouple the problem 
is a significant benefit. 


m=l 

n£L(m) 


Y = - 1 
nm 


E 

n£L(m) 


(t 1 " + c m H ) Y <5 
n nm — 
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(a) Original Problem 




(b) Decoupled Problem 

Figure 5. Specialization 
Prespecified Grouping of Components 

Although components may be mutually independent, reasons may exist 
which require certain components to be processed together. To guarantee 
these components are all assigned to the same DM, supercomponents are 
created. Let the set L(g) contain the set of components comprising this 
supercomponent, H(g) be the set’s entropy and s(g) be the set's dimension 
The set L of components comprising the input vector is redefined to be 
the set of supercomponents L(g) which has dimension G. 

The number of components that need be considered explicitly is G. 

The only modification to be made to the GN concerns constraint set (10) 
which is modified to account for the dimension of the supercomponents: 


-2 











(17) 


r' 



(s(g)t m + c m H ) Y 

g gm 


< 5 


in ~ 1 / 2; •«• f M 


The solution to the GN formulation is used to construct the information 

structure* However, the actual components, not the supercomponents, must 

be included in the information structure. For example, if Y = 1, y = 1, 
1 2 11 21 
Y 32 = 1, and L » (x^x^x^), L = (x 4 ), and N = 4 then 



so that 


X 1 X 2 X 3 X 4 

i o o o" 
0 10 0 
0 0 10 . 



[0 0 0 1 ] 


n = 



$ 


Summary 

In this section an implicit approach for allocating data among decision 

makers for parallel processing has been presented. This approach does not 

require each possible partition to be considered explicitly. As a result, 

N 

the size of the problem has been reduced drastically from order 2 to 
order N. The resource allocation problem was formulated as a generalized 
network and solved using one of the efficient GN algorithms. Several 
cases were examined in some detail under the assumption that all compo¬ 
nents of the input need not be processed by more than one DM. The weake¬ 
ning of this assumption is discussed in the next section. 
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REDUNDANCY 


Introduction of redundancy in the design of the single echelon 
requires that the problem be viewed from a different perspective. 

The concept of distributed database systems (DDSs) more clearly il¬ 
lustrates the need for including redundancy. 

Distributed database systems evolved to satisfy several needs. 

One need was to have the data which required constant updating near 
the users. A second need was to reduce vulnerability and thus allow 
the uninterrupted flow of information, should one data center fail. 

Redundancy, as interpreted with respect to SE structures, can be 
integrated with the concept of DDS . The concept of storing processed 
data requires a reexamination of what a SE structure is. It was 
initially defined to be a group of DMs who (i) are not hierarchical 
with respect to the boundary of the organization and (ii) perform 
a complex task. Two types of tasks now concern the SE. The first 
(original) task is to process the data of the input vector. The 
second task is to store the data, be it processed or not. This 
second task can be incorporated into the original problem by 
introducing constraints into the system which cause the original 
definition of efficiency to be violated. The original statement 
of objective required that a complex task be performed accurately 
using the minimum number of DMs while satisfying the constraints. 

Implicit in this objective was that each component of the input 
vector should be processed exactly once. 

Each DM in the DDS processes and stores the entire partition of 
components he receives. All components are again assumed mutually 
independent. A subset of these processed components is also transmitted. 
This subset can range from the entire partition of processed components 
to the empty set. Time is required to process, store, and transmit 
components. The storage time and transmitting time functions are 








assumed identical and are imbedded in a single processing time function/ 
The effect of redundancy on the ability to formulate the problem 
as a GN as well as on the dimensionality issue is significant. Three 
cases will be examined. 

The first case requires that each component x^ be processed and 

stored R times. If R is unity for all n, then this formulation 
n n 1 

defaults to the original GN formulation, for parallel processing. 

If R > 1 for at least one component, then on^y a minor modification 
is necessary. Constraint set (8) is modified so that 

- I Y - n = 1,2,...,N (18) 

run n 

m 

The only difference in constructing the information structure is that 
partitioning matrices and their associated vectors will not necessarily 
contain distinct components. 

The second case requires the R^ DMs must each process a specified 
set of components. Supercomponents, composed of the specified sets 
of components, are constructed. The formulation is identical to 
that for prespecified grouping of components except that the right 
hand side constants of constraint set (8) are now replaced with R^. 

The modified constraint set is 

Y = -R g g = 1,2,...,G (19) 

gm 



The information structure is constructed in an identical fashion to 
that for prespecified groupings of components. Again, the associated 
partitioning matrices and vectors will not necessarily have distinct 
components. 

In the third case, a particular group of components L', must be 
processed and stored by each member of a prespecified group of DMs, 

M 1 . it is assumed that these components do not overload these DMs. 
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If, however, the time required by the m-th DM to process his assigned 

components is strictly less than the available time 5 , additional 

components may also be assigned to him provided they do not overload 

him. An available processing time, 5 , is defined for each DM in M 1 , 

m 

which is equal to the difference between the original available 
processing time and the time required to process the specified 
components. 


Two modifications of the original GN formulation are made: 


a) All components whose assignments to DMs have been 
prespecified are omitted. To guarantee that each 
of the remaining components is processed once and 
only once the following constraint set is formulated, 


- 7 Y - -1 n£L" 

L^i nm 
m=l 

where L M is the set of unspecified components, 
b) To guarantee that no DM is overloaded the following 
constraint set is formulated; each 5 is replaced 
with the appropriate 5 . 



(t m + c m H ) V <5 
n nm — m 


m 1,2,...,M 


( 21 ) 


The variables, Y , are again restricted to be binary 
nm 

Y =*0,1 n € L' ; m * 1,2,...,M. (22) 

nm 

The partitioning matrix associated with each DM of the single echelon 

(SE) includes all components he was preassigned and all components for 

which Y * 1, n e L*. For example, if N = 3 and if DM, were pre- 
nm 1 

assigned components (x^x^x^) and al so were able to process component x c , 
so that Y 51 * 1, then his associated partitioning matrix would be: 
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ALTERNATE PROCESSING 


Information structures based on alternate processing are appropriate 
when the input vector cannot be partitioned, i.e., when the strategy of 
creating self-contained tasks cannot be used to avoid overload. The 
other strategy available to the organization designer is the creation 
of a slack resource, in this case, time. Thus, each DM is given more 
time to process the input assigned to him, which, as already mentioned, 
introduces a delay strictly greater than 5 . 

A deterministic strategy is one in which the ordering of the 
assignment of the input vectors to the DMs is fixed. In order to 
specify the optimal information structures associated with this strategy, 
it is necessary to determine simultaneously: 

★ 

a) the minimum number of DMs, M , necessary to 
process the input vectors without any one being 
overloaded and 

b) the frequency, q^, with which each of these DMs 
receives an input vector. 

A very simple method for solving this problem exists. The over¬ 
load constraint requires 


where t m is the average time for the m-th DM to process an input vector. 

Without any loss of generality, the DMs may be re-indexed according to 

their processing time functions: i.e., let the first DM be the most efficient 

-1 -2 -M 

and the m-th DM be the least efficient, so that T <_ T <_.•T , The other 
constraint on the problem is that all of the data be processed; 


* 



- 27 - 





where M has yet to be determined. The solution proceeds by choosing 
DMs in order of efficiency until 


1 


£ 5/f m > i 


A 


If the right hand side of (23) is an equality, then the minimum 
★ 

number of DMs, M , necessary to process the input vectors without over¬ 
load is equal to X, and 

! S /t m if 1 <^m X 

0 Otherwise 


If the right hand side of (23) is a strict inequality, then the 

* 

minimum number of DMs, M , is equal to X+l. 


Because 


S/T > 1, q must be defined as 


. -m m 

5 /t - e 


if 1 < m < X+l 


Otherwise 


where > 


e > o 


m = 1,2,...,X+l 


( 5 /t m - e m ) = 1 


These e may be set to ensure that all of the q^ are rational, so that 
a cyclical strategy can be used. 
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A cyclical strategy is defined as a strategy in which the ordering 
of the assignment of the input vectors to the DMs is repeated every 5 1 
input vectors. In the case that the right hand side of (23) is an equali¬ 
ty and at least one is irrational, a cyclical strategy cannot be used; 
but it may be argued that since the t m, s are usually estimated rather 
than precisely calculated, they can always be chosen to be rational and 
so a cyclical strategy may always be used. In this case, 5 ’ , the number 
of inputs in one cycle, is the lowest common denominator of the q^'s. 

The information structures for a deterministic cyclical strategy may now 
be completely specified. 

Define F to be the ordered set of indices on one cycle of 5* input 
vectors: that is# 

F ={f|f = 1,2,...40 


Now let F m be a subset of F where 


F m 5{f£ f| input is assigned to DM m} m = 1,2,, 


#M 


,m 


With the indicator variable defined as 


,m 


1 if f£F m m = 1,2,...,M 

0 Otherwise 


the only requirement on the assignment of input to DM m is that 

★ 

m — 1,2,..., M 

Since input vectors only arrive once every 5 time units, x^ is assigned 

at time t = (k5 * +f) 5 , where k = 0,1,_determines the number of cycles 

that have been completed at time t. Therefore, the information structure 
for DM m at time t is given by 
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I I if feF" 1 m = 1,2,... ,M 

(24) 

0 Otherwise 


A special case of the deterministic cyclical strategy is a periodic 
one characterized by the following properties: 

★ 

a) the length of the sequence is exactly M , the number 
of decision makers, and 

b) each DM is assigned exactly one symbol during the 
execution of the sequence. 

The information structure for the periodic strategy is given by 

I I t = (kM* + m) 5 t 

m * 1,2,...,M ; k« 0,1,2,... (25) 

0 Otherwise 

The relative frequency for a DM receiving a symbol for processing in the 
periodic case is 

* 

q^ = 1/M for all m (26) 

In order that no DM be overloaded, the mean symbol processing time must 
satisfy the following inequality: 

—m * . * 

t £ M 5 m = 1,2,...,M 

In this section, special cases are again explored, as in the section on 
parallel processing, to provide insight into the effect various properties 
have on the design problem. 

Identical Decision Makers 


In the first case, all DMs are assumed to possess identical properties: 
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a) the processing time functions of all the DMs are 
identical, 

b) the DMs are able to process any input symbol, and 

c) they have identical costs. 

Assumption (a) implies that only one mean processing time, T, need be 
computed. Since the DMs are identical it follows that 

= q <_ 5/T m = 1,2,. . . ,M. (27) 

The only other constraint requires 



(28) 


★ 

Therefore, M is the smallest integer that satisfies eq. (28) subject 
to the condition (27). The resulting strategy is periodic: the solution 
only requires that the relative frequency of symbol processing by a DM 
be 1/M*. 

The corresponding information structure is 

! I for t = (kM + m) 5 

★ 

m = 1,2,...,M ; k = 0,1.. 

0 Otherwise 

Groups of Identical Decision Makers 

Let there be G groups of decision makers denoted by M g , g - 1,2,...,G 

with the DMs within each group possessing identical properties. Let d be 

g — q ^ 

the dimension of M and let be the mean processing time for each member 

of M g . As in the introductory section on alternate processing, the groups 

are re-indexed according to their processing time functions so that the 
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1 G 

DMs in M are the most efficient and those in M are the least efficient: 

“1 -2 -g 

i.e., T <_ T <• . .<^ T . Then groups of DMs are chosen in order of effi¬ 
ciency until 


A+l A 

£ a , (?)> 1 - § 


(29) 


If the right-hand side of (29) is an equality, then 


M 


■t 


d and 

9* 


5 /T^ m e M^; g = 1 , 2 , . . . , A 


Sn 


Otherwise 


If the right-hand side of (29) is an inequality, then all of the DMs in 
M^ + ^ may not be needed. To calculate the minimum number of DMs from 
/ A , necessary to add to the A groups of DMs already selected, 
a procedure identical to that described in the introductory section on 
alternate processing is employed. Then 


• & ••) 


+ A 




- e 


m 


Sn 


m £ M g s 1,2,..«,A or 
~A+1 \+l 

m £M CM where the 
dimension of * A 


0 


Otherwise 


> 0 


e 


m 



1 


The information structures for both of these cases may be defined exactly 
as in (24). 

The alternate processing mode has been introduced as a means of 
implementing the second information reduction strategy, i.e., creation 
of a slack resource (time) to reduce information overload, as discussed 
in the introduction to this paper. 
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INFORMATION STRUCTURES FOR SINGLE ECHELONS 


In the previous three sections a detailed analysis of pure parallel 
and alternate information structures for the single echelon was presented. 
These two basic structures were explored under a variety of assumptions 
for the input symbols and the decision makers. The emphasis in the 
development was on procedures for allocating the input symbols and 
for determining the minimum number of decision makers needed to im¬ 
plement a specific structure. In the general case, however, the or¬ 
ganization designer is given only the properties of the symbol source 
and a limited number of decision makers who could form the single echelon. 
What is needed is a methodology for the design of the information struc¬ 
ture. Such a methodology, based on the results obtained so far is pre¬ 
sented in this section. It is then applied to an illustrative problem 
that requires integration of both parallel and alternate processing 
modes. 

The first two steps have already been presented. In the first one, 
the task is modeled as a source that generates vector signals for the 
organization to process. The second step consists of modeling the 
decision makers according to their processing time functions and their 
specialization, 

STEP 3: Information Reduction Strategy 
The two basic strategies are 

a) creation of self-contained subtasks, and 

b) creation of slack resources. 

The first strategy is applicable when the input vector can be partitioned 
into subvectors. The second strategy is feasible when the organization 
can tolerate some delay (beyond the mean interarrival time 5 ) in the 
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processing of the input vector. It is here that the organization 
designer's understanding of the task to be performed by the organization 
is crucial. He has to determine the extent to which parallel processing 
can be used and estimate the maximum tolerable delay. The latter deter¬ 
mines the extent to which alternate processing can be used. Assuming 
that the overall task can be accomplished by various combinations of 
alternate and parallel processing, he then has to assess the trade-offs 
between subdivision into smaller independent tasks and longer delays. 

Once he selects an integrated information reduction strategy, the 
designer proceeds to Steps 4 to 6. When he evaluates the resulting 
design, he can return to Step 3 and modify the strategy. 

STEP 4: Mathematical Model 

The next step consists of the formulation of the mathematical model 
that represents the integrated information reduction strategy selected 
in Step 3. There are four basic constraints, common to all strategies 
considered so far, that must be expressed analytically. 

a) All components must be processed. This is a key 
assumption; if any data were to be rejected, then 
their sources have to be eliminated from the super¬ 
source model. 

b) No decision maker is overloaded. This condition requires 
that in the final design the mean processing time of each 
decision maker in the echelon does not exceed the mean 
interarrival time for symbols (or tasks) received by him , 

c) Only decision makers who receive data from the supersource 
are members of the single echelon. The decision makers 
who are not used in the single echelon are assigned the 
null or empty subtask. 


d) Each DM is assigned at most one subtask. Additional 
constraints that are specific to the particular appli¬ 
cation can be introduced. 

STEP 5: Optimization Problem 

Each DM is assigned a cost that may depend on his capabilities 
and limitations in performing the tasks. Then the objective function 
to be minimized is the total cost of the DMs included in the single 
echelon. If the costs associated with each DM are assumed equal, then 
the optimization problem reduces to one of minimizing the number of 
members in the echelon. 

In various cases, under particular simplifying assumptions, solutions 
were obtained from reasonably simple and straightforward computations. 

If this was not the case, mathematical programming proved an attractive 
method for obtaining solutions. In particular, generalized network (GN) 
formulations proved most attractive because of the efficient algorithms 
which exist to solve them. Knapsack problems, and mixed integer linear 
programs can also be used. 

SETP 6: Information Structures 

The solution to the optimization problem yields the number (and 
identity) of the DMs comprising the single echelon and the assignment 
of a task or subtask to each DM. The results are expressed formally 
in terms of an information structure that consists of parallel or 
alternate processing, or a combination of both. The structure is 
evaluated to determine whether the tradeoffs between the number of 
DMs and delays are acceptable; if not, then the designer should return 
to Step 3 and revise the information reduction strategy. 

The six steps are applied now to a design problem that illustrates 
the methodology. 
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Problem 


Consider G distinct sources, each source generating a vector of 
signals. The task is such that each source output has to be processed 
intact, i.e., it cannot be partitioned. There are M decision makers 
who can receive the generated signals and none of these DMs can process 
the output of any of the G sources without being overloaded. A parallel/ 
alternate information structure seems appropriate. 

STEP Is Tasks 


The supersource consists of G synchronized sources that generate 
vector signals. The mean signal generation rate is <$ ^. The elements 
of the input vector can be partitioned into G sets, each set corresponding 
to the output of each of the individual sources. This is the finest grain 
decomposition of the input. 

STEP 2: Decision Makers 


The DMs constitute a group of M distinct members. 

STEP 3: Information Reduction Strategy 

The decomposition of the input vector allows for the parallel 
processing of the signals generated by the G sources. No further 
division into subtasks is possible. Since every one of the G subtasks 
arriving at a rate 5 1 cannot be processed by any DM without causing 
overload, the second information reduction strategy (creation of slack 
resources) must be used. Alternate processing of signals generated by each 
source would allow additional time for each DM to do the processing and 
therefore, overload may be avoided. The resulting processing mode is an 
integrated parallel/alternate processing. 






STEP 4 


Mathematical Model 


a) Since alternate processing is assumed for the output 

of each source, the requirements that all signals be 

processed reduces to the condition that the sum of 

the symbol assignment frequencies for the output of 

each source, q , must be equal to unity. This is 
gm 

expressed as eq. (30) 



g — 1,2,...,G 


(30) 


b) In order that no DM be overloaded, the frequency with 
which each receives a signal for processing should be 
sufficiently low so that his mean processing time 
does not exceed the effective mean interarrival time. 

This condition is given by eq. (31) 

0< q„<S/T m g=l,2,...,G; m * 1,2,... ,M (31) 

— gm — g 

c,d) Any DMs that receive input for processing with zero 

frequency are excluded from the single echelon. Further¬ 
more each DM is allowed to receive inputs from at most 
one of the G sources. Constraints (32) and (33) guarantee 

these conditions where the binary variable Y is zero 

gm - 

when the m-th decision maker is assigned the output of 
the g-th source. 



m ” 1,2,...,M 


(32) 


Y • q = 0 
gm gm 


g = 1,2,...,G? m = 1,2,...,M (33) 
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g = 1,2,-..,G? 


m = 


(34) 


STEP 5: Optimization Problem 


In a structure such as this, the number of decision makers that can 
process the incoming signals is a reasonable objective function to be 
minimized. Note that since the DMs do not have identical properties, 
the problem cannot be decoupled into G distinct optimization problems 
even though no decision maker is allowed to process signals from more 
than one source. The resulting mathematical programming problem is 
difficult to solve because of the nonlinearity of the constraint (33). 

STEP 6: Information Structures 

The information structure can be obtained directly from the solution 

to the optimization problem (the nonlinear MP). The single echelon 

is composed of only DMs for which the corresponding frequency q is 

gm 

strictly positive. The information structure, Figure 6, specifies th~ 
decision maker, the group of components g he processes and the frequency 
with which he is assigned these inputs. It is given by 

(i if f £ F m ; k = 0,1,... 

mm 1 9 

- (t) = TT [ (k ■$' + f) 5 I * \ (35) 

g g g ) 

10 Otherwise 

where 5 9 is the lowest common denominator of the q , m = 1,2,...,M and 
g ^gm 


F™ s if;input from source g is assigned to m-th DM' 
in ~ 1,2,...,M } g = 1,2,. ## ,G 
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COMPONENT GROUPS 


DECfSJON MAKERS 


wher*» /o\ input symbol Generation time 

Figure 6. Parallel/Alternate Processing 

Note that while the inputs from the sources are received by the single 
echelon simultaneously, the outputs are not synchronized. Indeed, each 
DM introduces a different delay; the maximum delay is given by the 
maximum value over m of 


S (l-q ) / q 

gm gm 


If this delay is unacceptable, then more efficient DMs are needed. 
The solution to the problem is illustrated now with a specific 


example. 








Let there be three distinct sources (G * 3) each generating a vector 
x^ in synchronization and let the rate be <$ = 1. 

L 1 : (x^/X^x^} 

L 2 : (x } 

4 

L 3 : {x^x^} 

1 2 

Let the size of the alphabets of the elements of L be ten, of L four, 
and of L 3 eight. Assume that the corresponding probability distributions 
are uniform. The M decision makers are assumed identical with processing 
time functions given by 


T * 0.5+0.25 

g ~ g 

l 


for all m,g. 


E H(x.) 
g i 

x. £3 j 
i 

The processing times for each group g are computed readily: 


m 


0.5 + 0.25 x 3 x log 2 10 = 2.99 


m 


0.5 + 0.25 x 1 x log 2 4 = 1.0 
0.5 + 0.25 x 2 x log 2 8 = 2.0 


Inequality (31) yields 


q 2m — 1 
q 3m i 1/2 


Application of (30) leads to: 


q il “ q i2 = q i3 = 1/3 


^24 

<*3S ' ’36 ' 1/2 
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0 


with all other q equal to zero- Constraints (32), (34) are satisfied 
gm 

by choosing Y equal to zero when q ? 0 and equal to unity when q 

gm gm gm 

To construct the information structure in accordance with (35), seve¬ 
ral quantities must be defined. Clearly, 


5 1 ■ 3 ' S 2 

= 1 ; 

6 ' =2 

since a periodic alternating 

strategy 

Fj_ = {1,2,3} 

with 

fJ = { 1 } 

f 2 - ( 1 ) 

with 

fJ = { 1 } 

f 3 = { 1 , 2 } 

with 

F 3 = { 1 } 


= {3} ; 


? 6 

'3 


Then, for k = 0,1,2,..., the partition matrices are given by 


TT^ (t) = tt™ (3k + f) = 


tt“ (t) = IT* (k + 1) = I 


*3 (t) = IT 3 ( 2 k + f) = 


I if f e F, 


0 Otherwise 


m 


I if f e F 


0 Otherwise 


and, finally, the information structure can be constructed: 

ntt) - (irj(t), TT^(t), irj(t>, tt* (t) , irj(t), irj(t>), 


The minimum number of DMs is six and the maximum delay is three units (i.e. 
3 5's). The IT (t) specifies completely the allocation of input signals to 
each member of the single echelon. 
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CONCLUSION 


An approach to the design of information structures for a single 
echelon organization has been presented. This approach is based on 
the properties of the inputs, the characteristics of the available 
decision makers, and the constraints imposed on the organization by 
the task. Two basic information reduction strategies, creation of 
self-contained tasks and creation of slack resources, were modeled 
as parallel and alternate processing, respectively. It was then 
shown that complex information structures can be constructed using 
combinations of parallel and alternate processing. The former is 
appropriate when an overall task can be divided into subtasks; the 
latter, when delays in producing an output cam be tolerated amd 
the task cannot be divided. 

The next major step in this research is the integration of the 
single echelon with other parts of the organization. The single 
echelon is responsible for transmitting the processed inputs to 
the appropriate destinations within the organization. This trans¬ 
mission of processed data to other members in the organization is 
referred to as serial processing. 

The design of multiechelon structures requires each echelon to 
process its information without overload. The constraints on each 
echelon, however, must be inferred from the constraints that are 
in\posed on the overall organization. This introduces a higher 
level of complexity to the design problem. 
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